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Let Xi, . . . ,X„ be a random sample from a p-dimensional pop- 
ulation distribution. Assume that cin" <p< C2n" for some positive 
constants ci,C2 and a. In this paper we introduce a new statistic for 
' testing independence of the p-variates of the population and prove 

, that the limiting distribution is the extreme distribution of type I 

with a rate of convergence 0{{logn)^^^ /^/n). This is much faster 
than 0(l/logn), a typical convergence rate for this type of extreme 
, distribution. A simulation study and application to stochastic opti- 

mization are discussed. 



1. Introduction and main results. Consider a p- variable population rep- 
J> ' resented by a random vector X = {Xi, . . . , Xp) with the covariance matrix S 

. and the correlation coefficient matrix R and let {Xi, . . . ,X„} be a random 

sample of size n from the population. In the applications of multivariate 
(SJ ' analysis in the century of data, both the dimension p and the sample size 

n can be very large, p may be comparable with n or even much larger than 
I n; see, for example, Donoho [4], and Fan and Li [11]. Since classical limit 

Q!^ ■ theorems for fixed p may not be valid for large p, it is necessary to develop 

new limiting theorems for large p. Whether the p-variables are indepen- 
dent is usually a primary step because independence seems to be a granted 
assumption for many limiting theorems. When n/p^ 7 > and the popu- 



^ I lation distribution is normal, several statistics have been developed to test 
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the complete independence of the p components of X. Johnstone [15] uses 
the largest eigenvalue of the sample covariance matrix and Ledoit and Wolf 
[17] use quadratic forms of the sample covariance matrix eigenvalues to test 
the null hypothesis Hq : S = 7p, where Ip is the p x p identity matrix, while 
Schott [20] uses the sums of sample correlation coefficient squares to test 
Ho : R = /p. When the normality is not present, Jiang [14] constructs a test 
statistic based on the largest entries of the sample correlation matrix. Write 



and let 



where 



— {Xk,i,Xk^2, ■ ■ ■ ,Xk,p), l<k<n 



7 I —("■) I 

Ln= max \pI-'\ 

l<i<j<p " 



and X^^^ = ^k=iXi^^i/n. Jiang [14] proves the following limit theorem con- 
cerning the test statistic L„: 

If n/p — > 7 G (0, oo) and E|Xii|^ < oo for some r > 30, then 

(1.1) Jmi^P(nL^ -41ogp + log2P<y) = exp(-e^^/^/\/87r) 

for y £ R, where and in the sequel log x = In max(2;, e) and log2 x = log(log x) . 

Zhou [21] shows that the moment condition ElXi^iC < cxo for some r > 30 
can be weakened to 

(1.2) x'^P(|^i,i^i,2| >a;) ^0 asx^cx). 

The limit distribution appearing in (1.1) is called the extreme distribution 
of type I. It seems a common belief that the convergence rate of this type 
of extreme distribution is typically slow (see Hall [13]). In fact, we shall 
prove [see Theorem 1.2 and (1.11)] that even when Xi^i has the standard 
normal distribution the rate of convergence is of order of 0(log2 ti/ logn). 
The main purpose of this paper is to introduce a modified test statistic and 
show that the new one also has an extreme limit distribution of type I, but 
with a rate of convergence of 0((logn)^/^/\/n). We shall also prove that the 
approximation rate of P(nL^ — 41ogp + log2P < y) to exp(— ^ ~^ P{x'^{l) > 
41ogp — log2P + y)) instead of the final limit exp(— e^^/^/\/87r) is indeed 
of order of 0((logn)^/^/\/n). This indicates that when a statistic has an 
extreme limiting distribution, one should use some "intermediate" approx- 
imation, not the final limiting distribution to approximate the distribution 
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of the statistic. Extreme hmiting distributions are important in various ap- 
phcations, including assessing risk for highly unusual events, hydrologic as- 
sessment, analysis of network simulation and engineering (see [12] and [16]). 
These results are partially motivated by the need for new approaches to 
applications of these types in practice. 

Throughout this paper let Hq be the null hypothesis that the p compo- 
nents of the population X are independent and have the same distribution, 
and let = (X^ i, Xfc_2) ■ • ■ > Xk,p), 1 < /c < n, be a random sample from the 
population X. Define 



(1.4) 



(1-3) L„= max •, 

i<i<j<P 

where 

'^ij' ~ (2^n,jj' "I" '^^n,i,j)/^n,i,ji 
[n/2] 

k=l 

n 

^n,i,j = X! iXk,i- X-"^^ ) {XkJ - Xj""^ ) , 
k=[n/2]+l 
n n 

k=l k=l 

where [n/2] denotes the integer part of n/2. Our test statistic is chosen as 

(1.5) Wn:=nLl-4logp. 

It is easy to see that rfj is a consistent estimator of the square of the 

correlation coefficient between Xi and Xj and that rfj > {pfjY ■ 

Instead of assuming that n and p have the same order, we consider a more 
general case. Assume 

(1.6) cin"<p<C2n", 

where ci,C2 and a are positive constants. 

Our first result shows that the Wn has an extreme limiting distribution 
of type I under a weaker moment assumption than (1.2) and the error of the 
approximation is of order of 0((logn)^/^/-y/n) under E|Xi^i|^+^" < oo and 
a>3/4. 

Theorem 1.1. Assume that (1-6) is satisfied and that 

(1.7) j;^+2"P(|Xi,iXi,2| > Vxlogx) as x^oo. 



4 W.-D. LIU, Z. LIN AND Q.-M. SHAO 

Then under Hq, 
(1.8) 

as n —> oo for any y £ R. If E|Xi^i|'^+'^" < oo and a > 3/4, then 



P(W„ < y) ^ exp ( - ^ exp 



(1.9) 



sup 

y&R 



P(W„ <y) - exp ( - 1- exp 



and C is a constant independent of n and p. 



The next result shows that (1.1) remains vahd under the assumption (1.7). 
Moreover, the convergence rate to exp(— 2^^P(x^(l) > 41ogp — log2P + y)) 
[x^(l) has a chi-square distribution with 1 degree of freedom] can also 
achieve the order of 0((logn)^/^/y^) when the 7th moment of Xi^i is finite. 

Theorem 1.2. Under Hq, if (1.6) and (1.7) are satisfied, then (1.1) 
holds. If E|Xi,ip+4a < oo anda> 3/4, then 



sup 

y&R 



P (nil - 4 log p + log2 p<y) 



(1.10) 



exp 



2 

P — P 



P(x^(l) > 41ogp-log2P + y) 



One can show that (see a proof in Section 5) if a = 1 in (1.6), then 



exp 



(1.11) 



2 

P — p 



P(x'(l) > 41ogp - log2P + y) ) - exp(-e-^/V^) 



log2 n 1 



8 log n VSvr 



exp 



y 

2 



exp 



So the rate of convergence in (1.1) is of order of 0(log2 ra/ logn). 
The following remarks are noted. 

Remark 1.1. The logarithmic term (logn)^/^ in (1.10) may not be 
sharp. Since our aim is to get the main order we will not seek the 

optimality of the logarithmic term in this paper. 



Remark 1.2. It is not necessary to require p and n have the tight 
relation (1.6). For example, when (1.6) is replaced by 



cin"^ <p< C2n' 
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for some positive constants ci, C2, ai and a, and assume that EjXi^il^^"''^")^'' < 
oo for some r > 6, then, following the proofs of Theorems 1.1 and 1.2, we 
have 



sup 

y&R 



P(W„ <y)- exp(^-iexp(^-|)) I < C(n-V2 (logp)5/2 +^-1+.) 



and 



sup 



P{nLl - Alogp + log2P < y) 



exp 



2 

P — P 



P(X^(1) >41ogp-log2P + y) 



<C(n-i/^(logp)5/'+p-i+") 

for e > 0, where the constant C may depend on e. When logp is of order of 
n'' (0 < r < 1), we shall discuss the case in our future paper. 



Remark 1.3. It is not necessary to assume that the p components 
of X are identically distributed in Theorems 1.1 and 1.2. For example, if 
inf„mini<j<p EX^j > and 

x^+^"sup max P(|Xi ,| > ^xlogx) ^0, 

n>ll<«<i<P 

then (1.8) remains valid. If, in addition, sup„maxi<j<p E|Xij p^^" < oo, 
a > 3/4, then (1.9) and (1.10) hold. 



The paper is organized as follows. In Section 2 we conduct a simulation 
study and give a simple application of Theorem 1.2 to the sparsest solution of 
large underdetermined systems of linear equations. In Section 3 we present a 
general theorem from which Theorems 1.1 and 1.2 can be derived easily. An 
outline of the proof of the general result along with five propositions is given 
in Section 5, while the detailed proofs of the propositions are postponed to 
Section 6. Proofs of Theorems 1.1 and 1.2 are given in Section 4. 

Throughout the paper, C will denote a positive constant that doesn't 
depend on n and p but may be different at each appearance. 



2. A simulation study and application to stochastic optimization. In this 
section we give a simulation study for performance of W„ and L„ and an ap- 
plication to the sparsest solution of large underdetermined systems of linear 
equations. 
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Table 1 

Estimated significance levels when a — 0.05 and Xi,i ~ N(0, 1) 



p 


Test statistics 


n = 16 


n = 32 


n = 64 


n = 128 


n = 256 


A 

4 


Wn 


A n /I o /I 
U.U4o4 


U.UooU 




A A KOA 


A AKi^i? 
U.UODD 




f 

^ncw 


u.uoio 






0474 






f , , 
-t^old 




09*^9 






0909 


8 


W„ 


0.0190 


0.0332 


0.0412 


0.0524 


0.0440 






0.0104 


0.0316 


0.0368 


0.0462 


0.0462 




iold 


0.0066 


0.0198 


0.0222 


0.0258 


0.0338 


16 


W„ 


0.0094 


0.0248 


0.0356 


0.0436 


0.0478 




^ncw 


0.0012 


0.0112 


0.0316 


0.0420 


0.0482 




Lold 


0.0002 


0.0130 


0.0246 


0.0312 


0.0338 


32 


W„ 


0.0032 


0.0188 


0.0366 


0.0412 


0.0432 




^ncw 


0.0000 


0.0094 


0.0228 


0.0368 


0.0376 




iold 


0.0000 


0.0044 


0.0212 


0.0280 


0.0364 


64 


>V„ 


0.0010 


0.0114 


0.0296 


0.0402 


0.0460 




^ncw 


0.0000 


0.0020 


0.0100 


0.0292 


0.0356 




iold 


0.0000 


0.0026 


0.0160 


0.0256 


0.0358 


128 


>V„ 


0.0004 


0.0082 


0.0218 


0.0350 


0.0568 




^new 


0.0000 


0.0000 


0.0060 


0.0262 


0.0380 




iold 


0.0000 


0.0000 


0.0060 


0.0170 


0.0362 



2.1. A simulation study. The performance of the test statistics W„ and 
Ln is carried out via simulation. Estimates of the actual significance levels 
are obtained from 5000 independent simulations with the nominal signifi- 
cance level a = 0.05. 

The simulation results for tests of Hq based on Wn in Theorem 1.1, L„ 
(denoted by Lncw) in Theorem 1.2 and L„ (denoted by Lold) in (1-1) ^-^e 
given in Table 1 when Xi^i has a standard normal distribution, and in Table 
2 when Xi^i has a t-distribution with 7 degrees of freedom. The estimated 
significance levels are usually lower than the nominal level 0.05, which indi- 
cates that the tests are conservative. The performances of Wn and Lncw are 
comparable and both are well when n is larger than p. 

2.2. An application to stochastic optimization. We apply Theorem 1.2 
to the problem of finding sparse representations of single measurement vec- 
tors (SMV) in an over-complete dictionary. The SMV problem can be de- 
scribed as follows. Given a single measurement vector b and a dictionary 
A, one wants to solve the system of equations Ax = b, where A is a n x p 
matrix, x is a p-variable vector and 6 is a n-variable vector. It is usually 
assumed that n <C p. A sparse representation means that vector x has a 
small number of nonzero components. Examples of such underdetermined 



A NEW TEST STATISTICS 



7 



Table 2 





11/jLLII LUiLCUi 


CI riTii It t*rtnn 
J LU 1 LLJ tCLLI fcLC. 


LCUCbJ (JUILCIL Lx, 




■ Lt v\ 1 ^ X ''7 




p 


Test statistics 


n = 16 


n = 32 


n = 64 


n = 128 


n = 256 


4 


VV„ 


0.0484 


0.0580 


0.0496 


0.0520 


0.0566 




^ncw 


0.0408 


0.0466 


0.0514 


0.0504 


0.0522 




Lold 


0.0192 


0.0242 


0.0286 


0.0276 


0.0300 


8 


Wn 


0.0374 


0.0560 


0.0624 


0.0574 


0.0586 






0.0084 


0.0332 


0.0468 


0.0440 


0.0470 




-*-'ola 


0.0054 


0230 


0290 


0358 


0.0372 


16 


Wn 


0.0292 


0.0536 


0.0750 


0.0676 


0.0622 




^ncw 


0.0012 


0.0186 


0.0324 


0.0436 


0.0446 




iold 


0.0004 


0.0146 


0.0308 


0.0336 


0.0366 


32 


W„ 


0.0144 


0.0682 


0.0886 


0.0758 


0.0664 




^ncw 


0.0000 


0.0102 


0.0294 


0.0414 


0.0444 




iold 


0.0000 


0.0062 


0.0244 


0.0336 


0.0436 


64 


_W„ 


0.0066 


0.0816 


0.1122 


0.1010 


0.0670 




Lncw 


0.0000 


0.0040 


0.0266 


0.0382 


0.0472 




Lold 


0.0000 


0.0042 


0.0196 


0.0352 


0.0388 


128 


>V„ 


0.0000 


0.1010 


0.1240 


0.1138 


0.0820 






0.0000 


0.0002 


0.0184 


0.0354 


0.0480 




i^old 


0.0000 


0.0002 


0.0178 


0.0342 


0.0438 



systems of equations include array signal processing, inverse problems and 
genomic data analysis. We refer to [2, 6, 7, 8] and [9] and references therein 
for a comprehensive description of many important applications of a SMV 
problem. 

A sparse representation can be found by solving the following optimization 
problem: 

(QO) min||x||o, s.t. ^x = 6, 

where the quantity ||x||o denotes the number of nonzero elements in the vec- 
tor X. The problem (QO) is essentially a combinatorial optimization problem, 
which, in general, is extremely difficult to solve. The above problem can be 
convexified as a ^i-norm minimization problem, and solved via linear pro- 
gramming. The ^i-norm minimization problem is 

(Ql) min||3;||i, s.t. = 6, 

where ||x||i is the sum of the absolute values of the elements of vector x. 
It has been proved that the solutions between (QO) and (Ql) are equiv- 
alent under various conditions. For example, letting G = A^A and M = 
maxi<j j<p^j^j \G{i,j)\, if ||x||o < (1 + M~^)/2, then x is the unique solution 
of (Ql) (for b = Ax) and this solution is identical to the unique solution 
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of (QO) [3]. Here we assume that ^ is a random matrix. Let n,p satisfy 
the condition in Remark 1.2 and {Xk^i,k,i > 1} be independent centered 
random variables satisfying the conditions in Remark 1.3. Define the nor- 
mahzed {k,i) element of A by Y^^i := X^^i/ {^'l^^Xl^y/'^ . Following the 
proof of Theorem 1.2, we see that (1.10) remains valid for = M^, where 



Mi 



max 



max 



Hence, (QO) and (Ql) are equivalent with probability 1 — a (0 < a < 1) for 



every x with fewer than (1 + mQ,)/2 nonzeros, where rria = \^n/{ya + 41ogp — log- 
and ya is the solution of 



exp 



2 

p — P 



P(X^(1) >41ogp-log2P + yo 



1 — a. 



When Xij above are i.i.d. standard normal random variables, the result is 



similar to that given in [5]. 



3. A general result. Instead of proving Theorems 1.1 and 1.2 separately, 
we give a general result in this section. Let d be a positive integer and 
{X,X^^^;k,i> 1,1 <m<d} be an array of i.i.d. random variables. Put 



Y, — (vW vK"-) \ 



(d) 



-^k,i,j ~ ^k,i ^k,j ' 



and 



where 



max 



k=l 



l<i<i<p 

denotes the Euclidean norm in R"^. 



i, j,k > 1,1 < m < d 



Theorem 3.1. Suppose that EX = and EX"^ = 1. Let X' he an inde- 
pendent copy of X , and 

(3.1) svi^x'^+'^'^P{\XX'\ > Vxlogx) < oo. 



Then for any < e < 10 ^ there exists a finite constant C such that 



sup 

ydB. 



^ ^ p,n 

n 



ap<y 



exp 



2 

P — p 



Pix\d)>ap + y) 



(3.2) < c.y-i+20Vi + c (^°g^^J^' E\XX'fl{\XX'\ < V^/(logn)4} 



n 



+ Cni+2°P(|XX'| > d-^/'^e^nk^), 

where Up = 41ogp — (2 — d)log2P and x^id) has a chi-square distribution 
with d degrees of freedom. 
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Now, set 

d n 

■P 

m=l k=l 

and Qn,i,j — ^n,j^r!,,j) 



II Y^" Y l|2 
r2 W Z^k=l^k,i,j\\ 
L^„= max — — 



Theorem 3.2. Under the conditions of Theorem 3.1 and < oo, we 
have, for any < e < 10~^, 



sup 



P{d'^nCl„_- ap<y) -expf- ^ ^ P(x^(rf) >ap + y) 



(3.3) <Cp-i+20v^ + C7ii^^ 

+ Cni+2"P(|XX'| > + 

The proofs of Theorems 3.1 and 3.2 are postponed to Section 5. 

4. Proofs of Theorems 1.1 and 1.2. We are now ready to see that The- 
orems 1.1 and 1.2 are two special cases of Theorems 3.1 and 3.2. 

Proof of Theorem 1.1. For the sake of simphcity, we assume that n 
is even. Otherwise use [n/2] instead of n/2 below. Without loss of generality, 
we assume EXi i = and EXf = 1. Set 

n/2 ^ n n/2 

■^n;i,j = '^^ Xj^iXi^j, Bn^iJ = E] -^k,i^k,j = ''^^ ^ k+n/2,i-^k+n/2,j 

k=l fc=n/2+l k=l 

n n 

^n,i,j = E E -^kj- 

k=l k=l 

Take d = 2 in Theorem 3.1. Since {An,ijf + {Bn,i,jf = \\{An,ij,Bn,i,j)f , by 
Theorem 3.1, 

pf max ^i^!l«l!±^i^!i«l!-41ogp<y 
\i<i<i<p n 

(4.1) , 

= p(??i^-41ogp<y)-e— 



10 

and hence, 
(4.2) 
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max l^n.ijl = Op{\/nlogn) and 

l<i<j<p ' ' 



max \BnA,j\ = Op{\/nlogn). 

l<i<j<p 

Noting that condition (1.7) imphes E|Xi^ip+^"~^ < oo for any e > (see 
Lemma 6.4), we can show, by Lemma 6.1, 



(4.3) 

and 

(4.4) 



\J2k=l-^k,i\ ^ 

max — = Up 

i<i<P n 



nogn 



n 



max ■ 

l<i<p 



En y2 
k=l^k,i 



■ n\ 



n 



Op{n-'), 



for some 5 > 0. Observe that 



ELi XI, - n(xf ))2] ELi xl^ - n{xfY] 



+ 2 



(Efc=n/2+l Xk,iXkjf - 2X2,ij Efc=n/2+l Xk,iXkj + (-'^2,ij) 



where 



Xi,,, = 2-in(xf + - ^X") = Op(logn), 



X' 



\ fc=n/2+l fc=n/2+l / 

= Op (log n). 

(1.8) now follows from (4.1)-(4.4). 

Now we prove (1.9). Let En,i,j = (An^ij)"^ + (Bn^ij)'^- We first show that 
Dn,ij in the denominator of rf^ can be replaced by Dn.i,j- Observe that 



TJU[{Xk,-x\-^?-x^ 



kA\ 



(Efc=i^fc,i) 



n 



We have, by Lemma 6.1, 



max 

\l<i<p 



(4.5) 



<pP\ 



k=l 



n 



> 2n 



> 4\/logn/n 



logn\ ^/^^ 



n 



(4.6) 



P[ max 

\i<«<p 
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n 



1 

> - 
- 2 



n 
fc=l 



and 
(4.7) 

Therefore, 

p(2n max 5^ < (1 - sVlog n/n)(y + a„)) - Cn"^/^ 

V i<i<j<P Dn,i,j " J 

< P(W„ < y) 

<p(2n max 5^ < {1 + 8^Jlogn/n){y + Up)) + Cn~^/^ 
Now write -Fn,jj = {An^ij,Bn,ij)- Note that 



P max 

\l<i<p 



n,i,j I 



This together with (4.7) leads to 

<(l-8v'logn/n)^/2(2/ + ap)V2 



P v2n max 



i<j<i<p n^/^ 



Clogn/V^j 



< P(W„ < y) 



<Pfy2^ max < (l + 8./logn/n)^/^(y + ap)^/^ 



+ Clogn/Vn ) +Cn 



Take d = 2 in Theorem 3.2. It is easily seen that P(2nmaxi 



x) = P(2n£p ^ 2;) for any x £ R. Write 
ln±{y) = 



77, 



n 



1/2 



12 

We have 



W.-D. LIU, Z. LIN AND Q.-M. SHAO 



P(2n/:2„/2<Z„_(y))-Cn"i/2 

(4.8) < P{Wn < y) 

<P(2n£2„/2<W(y)) + Cn-i/2. 

By Theorem 3.2, we obtain 



sup 



P(2'^^p,n,/2 < W(y)) - exp( --exp 



< sup 



exp 



P Pot 2, 



P(x^(2)>W(y)) -exp --exp 



1 



y 



+ Cn-i/2(iogn)5/2 + Cp-i+20v^ 
+ dni+2"P(|XX'| > 2-ie V^d^) + r„ 
= :supP„+(y) + Cn-i/2(logn)5/2, 



-i„+(s/)/2 

2 



1 



exp — - exp — - 



y 



where 

Pn+(y) = exp 
Note that 

(4.9) sup ln+ {y) - Op < -2 log2 n^ + C ")'^' . 



This imphes 



Also, we can get 



(4.10) 



sup Pn+{y)<Cn '\ 

i^< — 2 log2 rfi 



sup /„+ (y) - Op > 2 log n. 

?/>2 log n 



Therefore, following the inequality 1 — exp(— ^ exp(— |)) < Cexp(— |) for 

y>i, 

sup P„+(y) < 

y>21ogn 

A direct elementary calculation gives 

(4.11) sup \ln+{y)-ap-y\<C ^^''^J;l'\ 
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hence, by the inequahty |e^ — 1| ^ C\x\ for |x| < 1, 

sup Pn+{y) <Cn-^/^{lognf/^ + Cp-^logn. 

— 21og2 ■n^<y<2logn 

The above arguments yield 



sup 

yen 



P(2'^^?,n/2 < W(y)) - exp( -^exp 



<C7n-i/2(iQg^)5/2_ 



Similarly, 



sup 



P(2'^'Cj,n/2 <^n-(y)) -exp( -^exp( 



<Cn-i/2(iogn)5/2. 
The proof is now complete by (4.8) and the above two inequalities. □ 



Proof of Theorem 1.2. We assume that EXi,i = 0, EXf^ = 1. The 
proof of (1.1) is similar to that of (1.8), hence, is omitted. Now we prove 
(1.10). In view of Lemma 6.1 and the proofs of Theorem 1.1, we have 



exp 



P -Pdu.2 



P(x'(l)>/n,-(y)))-Cn-i/2(logn)5/2 



< P{nLl -ap<y) 



P -Pdu2, 



P{x\l)>ln+{y))]+Cn~^'\\ognfl\ 



< exp 



Moreover, it follows from (4.9), (4.10) and (4.11) that 



sup 

y<-21og2n8 



exp 



exp 



-^P(x'(i)>/n±(y)) 



sup 

j/>2 log n 



exp 



and 



sup 

-21og2 n*<y<21ogn 



exp 



exp 



-^^Pix\i)>ln±iy)) 



P -PdU.2 



P(x'(i)>«p + y))|<Cn-V2, 



exp 



-^-^P{x\i)>ln±{y)) 



-^P(x'(l)>a, + y) 



This completes the proof of Theorem 1.2. □ 
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5. Proof of the general result. In this section we outline the proof of the 
general result, Theorems 3.1 and 3.2. 

5.1. The truncation and notation. We first truncate X^^ij. Let e be a 
small positive number which will be specified later and put 

^k,i,j ~ ^k,i ^k,j ' 

l<k<n,l<i,j<p,l<m<d 

Xk,i,j = (^aI,!^) • • • ) ^kjj)' 
l<k<n, l<i,j<p, 



(5.1) 



and 



(5.2) 



^ kA,j 



y,. 



Xk,i,j — • ■ • ; ^kjj)' 



Try Yi — max 

l<i<j<p 



max ■ 

l<i<j<p 



k=l 

I Efc=i ^fc 



''P,n 



max 

l<i<j<p 



fc=i 



5.2. Auxiliary results. To prove the general result, we first collect some 
auxiliary results. As in many previous works on the Poisson approximation, 
we apply Lemma 5.1 below, which is a special case of Theorem 1 of Arratia, 
Goldstein and Gordon [1]. 

Lemma 5.1 (Arratia, Goldstein and Gordon [1]). Let {r]a,Q: € /} be ran- 
dom variables on an index set I. For each a€ I , let be a subset of I with 
a G Ba- For a given t £ R, set A = J2aei P(^a > 0- Then 



(5.3) 

where 



P ( max r7« < t I — e 



<(lAA-i)(6i + 62 + 63), 



61 = E E P{^a>t)P{v/3>t), 

62 = E E P{r]a>t,7]p>t), 

53 = E E|P(??a > t\a{r,p, (3 i B^)) - P(r?« > t)\ 



A NEW TEST STATISTICS 



15 



and a{r]i3,(3 ^ Ba) is the a-algehra generated by {r]j3,(3 ^ B^}. In particular, 
if Va is independent of {r]/3,(3 ^ Ba} for each a, then 63 = 0. 

The following estimates are also essential for our proof. 

Proposition 5.1. Under the conditions of Theorem 3.1, we have 



(5.4) 



sup 

-21og2 <y<2\o^n 



,(logn)^/^ 



1,2 



k=l 



> -P{x^{d)>ap + y) 



^ ^ 2 1/2 ^\XX'fl{\XX'\ < ^/(logn)^} + Cp-', 



p^n 



where yn = y («p + + 0(-\/logn/n)), 6 = 8r{d/2), and T{-) is the gamma 
function. 

Proposition 5.2. Under the conditions of Theorem 3.1, we have 



sup 

y< — 21og2 



n 



-expf — P{x^{d) >ap + y) 



Proposition 5.3. Under the conditions of Theorem 3.1, we have 



sup 

j/> 2 log n 



<c 



n 

(logn)^/2 



Op < y - exp 



n 



1/2 



E\XX'\^I{\XX'\<^/{\ognY} + Cp~^. 



Proposition 5.4. Under the conditions of Theorem 3.1, for any se- 
quence Vn satisfying Vn ~ 2^/rlTogp, we have 



E Xk,l,2 
k=l 



> Vr, 



E ■Xk,i;c 



k=l 



<Cp 



-4+20^/e 



Proposition 5.5. Under the conditions of Theorem 3.2, we have 



(5.5) 



sup 

j/<-21og2n' 



P{d nCpri — Oip<y) — exp 



2 

p — p 



Pix\d)>ap + y) 



16 
and 

(5.6) 
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sup 

j/>21ogn 



P{(fnCpn — otp<y) — exp 



(logn)5/2 
< 6 77;^ h r„ 



1/2 



Proofs of the propositions above will be given in Section 6. 
5.3. Proof of Theorem 3.1. Clearly, 



P{Wl^^Tl^)<dP(njB.^ _max, |y£),| > ^-^2^7^ 



(5.7) 



\l<k<nl<i<j<p 



IP 



< Cnp^P{\XX'\ > d~^/^ex/n\ogp). 
To prove Theorem 3.1, it suffices to show that 



(5.8) 



sup 

yen 



T2 



p,n 



n 



< y - exp 



-P{x^{d)>ap + y) 



Let / = {(i, j); 1 < i < J < p} in Lemma 5.1. For a = G /, set 



k=l 



and i?Q, = {{k,l) £ I; k = i or I = j}. Put t = ^na^ + ny. Noting that 77^ is 
independent of {r]p,P ^ -Bo} for each a E /, we have 



(5.9) 
where 



\PiTp,n<t)-e-^"\<hn + b2n, 



A„ = (l/2)(/-p)P 



fc=l 



,3d2 



fc=l 



fc,l,2 



>t\, 



E "^fc:1.2 
fc = l 



E ^'^.1.5 
k=l 



>t . 



Now (5.8) follows from (5.9) and Propositions 5.1-5.4. 
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5.4. Proof of Theorem 3.2. Assume that r„ < 1, otherwise (3.3) is trivial. 
It suffices to show that 



sup 

yeB. 



P{d n£p j^ - 0(p<y) — exp 



n 



1/2 



Following the proof of Theorem 3.1, by Lemma 5.1 again, we have 



(5.10) 
where 



\Pi(fnCl^-ap<y)-e^''"\<hn + b: 



An I 



fc=i 



fc,l,2 



>*1,2 , 



3d2 I 



bin < 2p'P 



k=l 



>tl,2 , 



b2n<pip^-p)P\ 



fc=l 



>tl,2, 



fc=l 



>il,3 



and 



Let 



Qn,i,j 
(Pn 



(ap + y). 



d n f 
m=lk=l ^ 



n 



logp 



Qn,i,j — ^n,i^nj') t 



Qn,i,j I , X 

^(ap + y). 



The main idea of the proof is to replace Qn,i,j by Qn,i,j and Qn,i,j by some 
nonrandom constants. 

We use Lemma 6.1 and let 5 = 1/4, M = 2, /3 = 1, a = 8L>i(l - M(5)-Mog^) 
and X = 32 X ^Ady/n logp in (6.1). So = and 



dn 



n 



logp 



> 32 X 34i 



'logp 



n 



< Cp- 



Let 



= (n{ap - 2 log2 n^) (^1 - EX^ll^X^ > 



n 



logp 



32 X 34i 



logpW 



n 
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Then v„ ~ 2^/nlogp. Note that An^ij > An.i.j and, hence, Qn,i,j > Qn,i,j- By 
Proposition 5.4, 



sup P 

j/>-21og2 nS 



k=l 



>il,2, 



fc=l 



(5.11) 



< sup P I 

j/>-21og2 n» 



<P 



Xk,i,2 

k=i 



k=l 



> Vn, 



>h,2, 



fe=l 



> ii,3 



fc=i 



Moreover, by Proposition 5.1, for — 21og2ra^ < y < 21ogn, 



fc=i 



>ii,2 



<P 



<P 



k=l 

n 

y^ -^fc,i,2 



>ii,2 



fc=l 



> •y/n(ap + y)(l-t„) +Cp" 



<P(x'(t^)>ap + y)| + C 



(logn)^/^ 



2^1/2 



where tn = C ^y\ogn/n. Note that 



fc=i 



>P 



>tl,2 



y^ Xk^i,2 

k=l 



>h,2 



2d^P| 



y^ ^fc,i,2 
fc=i 



>tl,2,{^i,l) > 



logp 



For y > -21og2n^, letting (3 = 192e, g = 4a, r = 2 + 2a, 6 = 12e/5 and x : 
2(1 — 2e)\/nlogp in (6.2) yields 



y^ ^/c,i,2 
fc=i 



>tl,2,(41V> 



n 



logp 
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<P| 



k=l 
n 



1,2 



n 



logp 



+ Cp- 



n 



logp 



<C\p' 



-2(l-10v/?) 



n 



1/4 



1/4 



For — 21og2?^^ < y < 21ogn, it follows from Proposition 5.1 that 
>ii,2 I > P| 



1,2 



fc=i 



k=l 



> Jn{ap + y){l + tn) - Cp' 



>PixHd)>a, + y)-C^^^^^-Cp-\ 



Combing the above inequalities gives 



sup 

-21og2 n®<j/<21ogn 



1,2 



k=l 



>ti,2] -P{x\d)>ap + y) 



(logn)^/^ 



(5-12) <c'-±Yrr + Cp 



p^n 



+ Cnp-2(i-i0v/^)pf|X|> 



^1/4 



(iogp)i/4;- 

The proof of Theorem 3.2 is now complete by (5.10)-(5.12) and Proposi- 
tion 5.5. 

6. Proofs of auxiliary results. To prove Propositions 5.1-5.4, we need 
some preliminary lemmas. 

The first is a Fuk~Nagaev type inequality for vector-valued random vari- 
ables. 

Lemma 6.1. Let ^i, 1 <i <n, be independent random vectors in R'^ with 
Ed = and E\\Cif < 00, l<i<n. Put Sn = ELiCi- Then /or < 5 < 1, 
/3 > 0, o > and any x > 0, 



P max ||5fc|| >x + 3E||5„|| +8-S„a;a 

,l<A:<n X 
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M 



(6.1) 

((1-M5)x 
+ exp' ^ 



2(1+/5)A„ 
(1-M(5)a 



where A„ = sup{X]fc=i E(?x,.^fc)^ : ||u|| < 1}, (•, •) denotes the Euclidean inner 
product, J:n,x,a = El=i^^k\\^I{Uk\\>x/a}, = 11(1 + 2//?), M is a pos- 
itive number satisfying M6 < 1, and C is a constant which depends on M 
and 6. 

In particular, if maxi<fc<„ E||,^j||^' < K for some r > 2 and K < cxo, then 
for any q>2 and < (3 <1, there exist Ci, C2 depending only on (3, q, K 
such that, for any x > C2\/n and <6 < /3(r — 2)(32g + 16r — 32)"-'^, 



(6.2) 



P max ||5fc|| > X 

\l<k<n 



n 



k=l 

Proof. Put 

l=m\m\<sx}, Sn=Y.i 

i=l 
n 

i^ = m\M<x/a}, 5„ = 5^|,, 

i=l 

n 

^^=mx/a<\M<Sx}, Sn = Y,Ci 

1=1 

and write 



B„ = 3E||5„|| + 8- E Elie^f /{ll^fcll > x/a}. 



Then 



(6.3) 



PI max \\Sk\\'>x + Bn 

\l<k<n 

< Pf max \\Sk\\ >x + Bn)+f] Pi\M > 5x) 

\l<k<n J ^ 
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<P( max \\Sk\\>{l-M5)x + Bn/2)+YP{\\Ck\\>Sx) 

\ ^<k<n J f — ^ 



+ P max \\Sk\\>M6x + Bn/2 

\l<k<n 

Since E^j^ = for 1 <k <n, we have 

3[ 



max ||E5i.|| + ^E||5n — ES^II < -B„/2. 

l<fc<n ^ 



Hence, 



P max \\Sk\\>{l-M6)x + Bn/2 

,l<fe<n 

(6.4) < pf max \\Sk - ESk\\ > (1 - M5)x + |E||S„ - ES„ 

\l<k<n 



2(1 + /J)A„ / 2Dg 

where the last inequahty follows from (3.4) in Einmahl and Li [10]. 

We now estimate P(maxi<fc<„ \\Sk\\ > M5x + Bn/2). It follows from the 
Hoeffding-Bennett inequality that 

p( max \\Sk\\>M6x + Bn/2 

\l<k<n 



<P\Y.\\U\>M5x + Bn/2j 

( n \ 

<p 5:(iie.ii-E|i^;ii)>Mfe 



< 



\A:=1 / 

3ELlE||6f/{||g.||>x/a} ^^ 
MS^x'^ 



So (6.1) is proved. 

In order to prove (6.2), we let o = max(2DT-q(l — M(5i)~^ logn, ^['"'^ + 1), 
where b\ and r are positive numbers which will be specified later. Then 

/ (1-M5i)a\ _^ 

Note that EUS'nll < C^/nK^'''. Since '^rL,y,a ^ Kn{cLy ^6 have, for 

< C'ni-'~/2(logn)'^"2. Now take Af = (r - 2)-i(2g + r - 2) and < 5i < 
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P{r - 2)(16g + 8r - 16)"^ such that M(r/2 - 1) > q and M5i < (3/8. Let 



Pf max ||5fc||>(l + /3/8)y) 

\l<fc<n / 



<P max ||5fc|| >y + 3E||5„||+8 

\l<k<n y 



k=l 



where we let r satisfy (1 - (3/8f{l + r)~^il + /?/8)"2 > (1 + Setting 
C2 = (1 + /3/8)C4, -5 = (1 + /3/8)-i(5i and x = y{l + /?/8), we obtain (6.2). 
□ 

The following moderate deviation for independent random variables will 
play an important role in our proof. 

Lemma 6.2. Let ^i, 1 < i < n, be independent random variables with 
E^i = 0. Put 



n 

i=l i=l i=l 

Assume that 

ICi I — ^n^n 

for 1 <i <n and some < c„ < 1. Then 

(6.5) PiSn > XSn) = e^("/'^")(l - ^{X)){1 + e„,,(l + X)s-\n) 

for < X < l/(18cn), where \9n^x\ ^ 36 and 7(x) is the Cramer-Petrov series 
(see Petrov [18]) satisfying \^{x)\ < 2x^TnS~^. In particular, we have 

(6.6) P{Sn > XSn) = (1 - $(X))(1 + a„,,.(l + xfs-\n) 

forO<x< l/(18cy^), where |6'n,x| < 40. 

Proof. (6.5) is due to Sakhanenko [19] (see Example 1 in Sakhanenko 
[19]) and (6.6) follows from (6.5). □ 



The next lemma is simple but useful to provide a moderate deviation of 
the convolution of independent sums. 
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Lemma 6.3. Let Ui, U2, Vi and V2 be independent random variables. 
Assume that there exist < cq < 1 and xq such that, for any < x < xq, 

(6.7) P{\Ui\ >x) = P{\Vi\ > x)(l + 01,,) 
and 

(6.8) P{\U2\ >x) = P{\V2\ > x)(l + 02,^), 
where \9i,x\ < cq and |02,a;| ^ cq. Then 

(6.9) PiUf + C/| > x^) = PiV^ + vi > x2)(l + 6^) 
for < X < xq, where \0r^\ < 3co . 

Proof. Observe that P(|t/i| > x) = 1 = Pi\Vi\ > x) for x < 0, so 
(6.7) and (6.9) remain valid for a; < with 6i^x = = 62,x- Hence, for < 

X < Xq, 

P{U! + Ul > x^) = E{P{Uf >x^- Ul\U2)} 

< E{P{Vi >x^- C/||C/2)(1 + 0i,.2_^|)} 

<E{PiVi>x''-Ul\U2)il + co)} 
<(1 + co)P(C/|>x2-F2) 

(6.10) 

= E{PiUl>x''-Vi\Vi)} 

<{l + co)E{P{Vi>x^-Vi){l + co)} 

= {l + cofP{Vi + Vi>x^) 

<{l + 3co)P{Vi + Vi>x^). 

Similarly, 

P{U! + C/| > x^) > (1 - co)P(t/| >x^- Vi) 

(6.11) >(l-co)2p(Fi2 + y|>^2) 

>{l-2co)P{Vi + Vi>x^). 
This proves (6.9) by (6.10) and (6.11). □ 

Remark 6.1. It is easy to see that Lemma 6.3 remains valid for m 
independent squared variables. 

Lemma 6.4. If condition (1.7) is satisfied, then 

(6.12) E(|Xi,i|2+4-/(l + log|Xi,i|)^+4-)<oo. 
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Proof. It is easy to see that (1.7) implies 



E(|Xi,iXi,2|^+^7(l + l0g|Xi,iXi,2|)™)<00, 

which yields (6.12) by the independence of Xi^i and Xi^2- D 

Proof of Proposition 5.1. Let Xk,i,2, -^fc,i,2, Y^^i2 defined in 
(5.1) and (5.2). Let 

d n 



^^yu{in':Li>^ 



Then 



1,2 



fc=l 



(6.13) 



<P 



E -^^,1,2 
k=l 

n 

k=l 



>Vnyn,Aj +P| 
>V^yn,A] +P| 



fc=i 

n 



fc=l 



> Vnyn ■ 



First, we prove that P(|| J2k=i-^k,i,2\\ > V^yn,A) is smaU, that is, 



sup P 

-2 log2 n^<y<2\ogn 



E ^k,l,2 
k=l 



(6.14) 

Noting that for — 21og2?T-'^ ^y ^ 21ogn 



k=l 



1=1 

n 

(6.15) <dJ2^\ 

i=l 
n 



fc=l 



(logn) 



i=l 



k=l,k=/=i 
n 

E 

k=l,k^i 

(1) 



>2(l-e)v/7d^,|yi';2l > 



77, 



(log 77)^ 



> 2(1 — e) v^dogp 



xp ini2i> 



71 



(logn)^/ ' 
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we have, by Lemma 6.1, 



J2 ^^,1,2 



<P 



> 2(1 — e)\/nlogp 



> 2(1 — e)\/n logp 



< dnP(|y/i^2l > d-^/^e^/nk^)+nP{\\Xi^i^2\\ > S^/^Tk^) 
4(1 — e)^nlogp' 



+ exp ( - 



2(1 + /3)A„ 



< CnP(|y/i^2l > S'Vnlogp) + exp 



2(1 — e)^nlogp 

(l+/3)An 



where 6 and are some positive numbers, (3 is any positive number, q is 
a large number and A„ = (n — 1) sup{E(u, Xi^i^2)^ : < 1} = n — 1. For 
— 21og2n^ <y< 21ogn, by letting (3 small enough such that (1 — e)^(l + 
P)"^ > 1 — 2^/e, we have 



exp 



2(1 — e)^nlogp 



(1+/3)A. 

By Markov's inequality and Lemma 6.4 



and 



n 



p(|yS2l > <5'V^ns^)p( 1^7,1 > 



\ (logn)V 



n 



(logn)^ 



This proves (6.14). 

Now we come to estimate P(|| Z]fc=i -^fc,i,2|| ^ V^Vn)- Observe that 



1,2 



(6.16) 



k=l 



<P 



<P 



> Vnyn 



k=l 



(n6„)-i/2^(lfc,i,2-EXfe,i,2 

k=l 



>yn-Cn\, 
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where a„ = E||Xi,i,2||/{||Xi,i,2|| > V^/(logn)4}, 6„ = Var(y£)2) and 
c„ = CV^a„ + Cyi^E|y/\)2|2/{|y«2| > V^/(logn)4} 

for any 6 > 0. By Lemma 6.2, for < x < (logn)'^/'^/100, we have 

fc=l 

= 2(1 - $(x))(l + ^„,,(1 + x)3(n6„)-3/2r„), 

where 9n,x < 40 x 8 and r„ = nE|y/^2p- So by Lemma 6.3 (see also Re- 
mark 6.1), we get, for < a; < (logn)^/VlOO, 



> \/nx 



(6.17) 



k=l 



> nx 



where 9'^ ,, < 3'^~^320. Puttmg (6.16) with (6.17) together yields, for -21og2n^ < 
y < 21ogn and some < C < oo (not depending on y), 



^k,l,2 

k=l 



> Vnynj 

< PixHd) > yl) + Cnyt^ exp(-(y„, - Cnf /2) 



+ C?{x\d) > {yn - c„)2)(l + y„)3(n6„)-3/V„ 

< Pix\d) >ap + y) + Cp-2n-i/2(iogn)5/2 

< P{x\d) >ap + y) + C{p~^ + p-\lognf/\~'/^E\Y,%f). 
Similarly, we have, for — 21og2ra^ < y < 21ogn, 



E^k., 



1,2 



k=l 



> Vnyn 



This completes the proof of Proposition 5.1 by combining the above inequal- 
ities. □ 
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Proof of Proposition 5.2. Since 
(6.18) P{x\d) > x) ~ 2i-'^/2p-i(^/2)x^/2-i exp(-x/2) 

as X — > oo, we have 
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(6.19) sup exp(-^-^P(x'((i)>ap + y)) <Cn-2. 

j/<-21og2n» V ^ / 

Noting that 

(6.20) sup P(fp2„ - nap < ny) < P{f^^„, < nap - 2n logs ^^), 

y<-21og2n^ 

Propositions 5.1 and 5.4 imply 

(6.21) P(fp2„ < nap - 2n logg n^) < e'^" + Cp-^+^°^, 
where 



(fn = — — P 



1,2 



k=l 



> J nap — 2nlog2 . 



By Proposition 5.1 again, we have <pn > 21ogri for n large. Now Proposition 
5.2 follows by (6.19), (6.20) and (6.21). □ 

Proof of Proposition 5.3. By (6.18), 



(6.22) sup 

j/>21ogn 



1 - exp ( - ^—^ P ix^ {d)>ap + y) 



< Cn-^. 



Moreover, by Proposition 5.1, 
sup P(fp2„ 

3/>2 log n 



> nap + ny) < P(rp „ > nap + 2nlog 



n 



(6.23) 



<C 



1,2 



fc=l 

(logn)^/^ 



> nap + 2n log n 



ni/2 



E|XXf /{l^^'l < V^/(logn)^} 



Proposition 5.3 now follows from (6.22) and (6.23). □ 
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Proof of Proposition 5.4. Observe that 



i=l 



<P 



> Vn, 



n 

4 = 1 



(6.24) 



<P 



<P 



5](Xi,i,2 - EXi,i,2) > (1 - e)vn, 
i=l 

n \ 

5^(Xo,3 - EX,,i,3) >(l-eK 
1=1 ) 

n 

E(^i,i,2 — EXj,i^2, ^1,1,3 — EXj^i^a) 

i=\ 

n 



>2((l-e)^;„)^ 



>2((2-3e)V^d^)"j. 

Take /3 = 192e, g = 4a, r = 2 + 2a, 5 = /?(r - 2)(32g + 16r - 32)-^ = 12e/5 
and X = \/2(2 — 3e)-v/nlogp in (6.2). Since ||Xj^i^2|| < e-v/nlogp, we have 

(6.25) P(||(^i,i,2 - EXi,i,2,Xi,i,3 - EX,,i,3)|| > bx) = 0. 

It can be shown that the largest eigenvalue of the covariance matrix of 
(^1,1,2 — EXi^i^2; -^^1.1,3 — EXi.1^3) tends to 1 as n — > 00. Therefore, for < 
e < 10-^, 



(6.26) exp 



X 



2(1 + 192e)A^ 



< C exp 



(2-3e)2logp 
1 + 193e 



Proposition 5.4 is proved by (6.2) and (6.24)-(6.26). □ 



Proof of Proposition 5.5. The proof of (5.5) follows from the proof 
of Proposition 5.2, while the proof of (5.6) is similar to that of Proposition 
5.3. The details are omitted here. □ 

Proof of (1.11). Let 



An 



P(x(l)>2/n)> 2/n = \/41ogp-log2P + y. 



It is known that 
(6.27) ^ 



27ry„ V Vn 



2vry„ 
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Thus, 



An < 4^ exp (-yl) = (^'-P-'I^P exp U 



By (6.27) again, 



An > 7= exp - - -O 



V2Tryn \ 2/ Vlogn 

Hence, 

An = -j== exp - - + An^== exp - - + C 



"V 2) ' ^^^'VS^^^^^V 2; ' ^Vlogn 
where An ~ log2 ra/(81ogn) as n — > 00. Finally, we can write 

_.„,e.p(-^e.p(-|)), «,..i|g-l.e.p(-|; 

This proves (1.11). □ 
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